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recording medium. 

According to one aspect of the present invention, an image data generation 
apparatus includes: reception means for receiving a parameter for displaying three- 
dimensional image data; three-dimensional image display control information generation 
5 means for generating three-dimensional image display control information by encoding 
the parameter; and file generation means for generating a multimedia information file 
including both of the three-dimensional image display control information and the three- 
dimensional image data, or at least two-dimensional image data. 

According to another aspect of the present invention, an image data generation 
10 apparatus generates a multimedia information file including both of image pick-up 

condition informatio n indicating an im age pick-up condition for a three-dimensional . 
image and three-dimensional im age data, or at least two-dimensional image data. The 
image pick-up condition information includes at least one of information indicating the 
number of parallaxes in a horizontal direction and information indicating the number of 
15 parallaxes in a direction perpendicular thereto. 

According to yet another aspect of the present invention, an image data 
generation apparatus generates a multimedia information file including both of image 
pick-u p condition information indicating a n im a g e pick -up condition for a three- 
dimensional image and three-dim ensional image data, or at least two-dimensional image 
20 data. The image pick-up condition information includes at least one of information 
indicating 
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a camera arrangement shape, information indicating an interval between adjacent 
cameras, and information indicating a distance from a camera arrangement plane to a 

convergence point. 

According to yet another aspect of the present invention, an image data 
reproduction apparatus includes: reception means for receiving a multimedia information 
file including both of three-dimensional image display control information generated by 
encoding a parameter for displaying three-dimensional image data and the three- 
dimensional image data, or at least two-dimensional image data; file structure analysis 
means for analyzing a structure of the multimedia information file so as to extract the 
three-dimensional image display control information and the three-dimensional image 
data or the two-dimensional image data; three-dimensional image display control 
information analysis means for analyzing the three-dimensional image display control 
information; data reproduction means for reproducing the three-dimensional image data; 
and data conversion means for converting the reproduced three-dimensional image data. 
The data conversion means converts the reproduced three-dimensional image data for 
data for display, based on a result of analysis by the three-dimensional image display 
control information analysis means. 

According to yet another aspect of the present invention, an image data 
reproduction apparatus includes, reception means for receiving a multimedia information 
file including three-dimensional image display control information obtained by encoding 
a parameter for displaying three-dimensional image data and the three-dimensional 
image data, or two-dimensional image data; and file type determination means for 
analyzing an extension of the multimedia information file. The file type determination 
means determines whether or not the multimedia information file includes the three- 
dimensional image data or detenmnes on wh ich three dimensional dis play scheme data is . 
based on. based on the extension. 

According to yet another aspect of the present invention, an image data 
reproduction apparatus reproduces a multimedia information file including both 
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10 



gDmm pjgk.uE condition in flation indicating an image pick-up condition for a 
tto^dime^^ two-dimensional 
image data. The image pick-up condition information includes at least one of 
information indicating the number of parallaxes in a horizontal direction and information 
indicating the number of parallaxes in a direction perpendicular thereto. 

According to yet another aspect of the present invention, an image data 
reproduction apparatus reproduces a multimedia information file including botfiMimage 
m m condition information i^ting an ima P e niok-up condition for a three- 
^^^^ image 
data. The image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between 
adjacent cameras, and information indicating a distance from a camera arrangement 
plane to a convergence point. 

According to yet another aspect of the present invention, an image data 
recording medium records a multimedia information file including both of three- 
dimensional image display control information generated by encoding a parameter for 
displaying three-dimensional image data and the three-dimensional image data, or aL 
least two-dimensional image data. 

According to yet another aspect of the present invention, an image data 
recording medium records a multimedia information file including miofmm^=m- 
condition information indicating^^ 

i|Mge _^^ The 
image p 1C k-up condition information includes at least one of information indicating the 
number of parallaxes in a horizontal direction and information indicating the number of 
2 5 parallaxes in a direction perpendicular thereto 

According to yet another aspect of the present invention, an image data 
recording medium records a multimedia information file including mLolMm^=^ 
gonditjon ir&nnation indica ting an image pick- u p condition for a thr ee. 



20 
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d^nenjiona] image a^ thr^-dimensional image data or atjeast two-dimensional image 
data. The image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between 
adjacent cameras, and information indicating a distance from a camera arrangement 
5 plane to a convergence point 

According to yet another aspect of the present invention, an image data 
recording medium records, in a recording area, a multimedia information file including 
both of three-dimensional image display control information generated by encoding a 
parameter for displaying three-dimensional image data and the three-dimensional image 
10 data, or at least two-dimensional image data. The recording area includes an image 
recording area for recording the three-dimensional image data or the two-dimensional 
image data, an audio recording area for recording audio data, and a sub code area for 
recording associated information. 

Therefore, according to the present invention, the three-dimensional image 
15 display control information for displaying the three-dimensional image data is recorded 
or configured as a multimedia information file together with the three-dimensional image 
data. Therefore, the three-dimensional image data can be versatile, and one kind of 
multimedia information file can adapt to various three-dimensional display schemes in a 
flexible manner. 

20 Alternatively, according to the present invention, by analyzing the three- 

dimensional image display control information included in the multimedia information 
file, conversion of the three-dimensional image data adapted to a display method can 



-7- 



Translation o£ Annexes to IPER (Substitute Page) 



CLAIMS 

1 An image data generation apparatus comprising: 
reception means for receiving a parameter for displaying three-dimensional 
image data; 

three-dimensional image display control information generation means for 
generating three-dimensional image display control information by encoding said 
parameter; and 

file generation means for generating a multimedia information file including both 
of said three-dimensional image display control information and said three-dimensional 
image data, or at least two-dimensional image data. 

2. The image data generation apparatus according to claim 1 , further 
comprising recording means for recording said multimedia information file. 

3 . The image data generation apparatus according to claim 1 , wherein 

said file generation means outputs said multimedia information file to an external 
communication path. 

4. The image data generation apparatus according to claim 1, wherein 

said three-dimensional image display control information includes at least one of 
first information indicating a number of viewpoints of said three-dimensional image data, 
second information indicating from which viewpoint position said three-dimensional 
image data is obtained, third information indicating a direction of sub-sampling of said 
three-dimensional image data, fourth information indicating arrangement of a camera 
that has picked up said three-dimensional image data, fifth information indicating a 
maximum shift amount when a parallax image of said three-dimensional image data is 
shifted, sixth information indicating whether a border is to be displayed around an image 
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of said three-dimensional image data, seventh information indicating border image data 
to be displayed around the image of said three-dimensional image data, and three- 
dimension identification information indicating that said multimedia information file 
contains the three-dimensional image data. 

5 

5. (Cancelled) 

6. The image data generation apparatus according to claim 1 , wherein 
said file generation means provides a different extension to said multimedia 

10 information file between when said multimedia information file contains the three- 
dimensional image data and when said multimedia information file contains no three- 
dimensional image data. 

7. The image data generation apparatus according to claim 6, wherein 

15 said extension adapts to said plurality of different three-dimensional display 

methods and is different for each of said plurality of three-dimensional display methods. 

8. (Cancelled) 
20 9. (Cancelled) 

10. An image data generation apparatus generating a multimedia information 
file including both of image pick-up condition information indicating an image pick-up 
condition for a three-dimensional image and three-dimensional image data, or at least 
25 two-dimensional image data, wherein 

said image pick-up condition information includes at least one of information 
indicating a number of parallaxes in a horizontal direction and information indicating a 
number of parallaxes in a direction perpendicular thereto. 
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11. An image data generation apparatus generating a multimedia information 
file including both of image pick-up condition information indicating an image pick-up 
condition for a three-dimensional image and three-dimensional image data, or at least 
two-dimensional image data, wherein 

said image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between 
adjacent cameras, and information indicating a distance from a camera arrangement 
plane to a convergence point. 

12. An image data reproduction apparatus, comprising: 
reception means for receiving a multimedia information file including both of 
three-dimensional image display control information generated by encoding a parameter 
for displaying three-dimensional image data and said three-dimensional image data, or at 
least two-dimensional image data; 

file structure analysis means for analyzing a structure of said multimedia 
information file so as to extract the three-dimensional image display control information 
and said three-dimensional image data or said two-dimensional image data; 

three-dimensional image display control information analysis means for analyzing 
said three-dimensional image display control information; 

data reproduction means for reproducing said three-dimensional image data; and 
data conversion means for converting said reproduced three-dimensional image 
data; wherein 

said data conversion means converts said reproduced three-dimensional image 
data for data for display based on a result of analysis by said three-dimensional image 
display control information analysis means. 

13. The image data reproduction apparatus according to claim 1 2, wherein 
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said three-dimensional image display control information includes at least one of 
first information indicating a number of viewpoints of said three-dimensional image data, 
second information indicating from which viewpoint position said three-dimensional 
image data is obtained, third information indicating a direction of sub-sampling of said 

5 three-dimensional image data, fourth information indicating arrangement of a camera 
that has picked up said three-dimensional image data, fifth information indicating a 
maximum shift amount when a parallax image of said three-dimensional image data is 
shifted, sixth information indicating whether a border is to be displayed around an image 
of said three-dimensional image data, seventh information indicating border image data 

10 to be displayed around the image of said three-dimensional image data, and three- 
dimension identification information indicating that said multimedia information file 
contains the three-dimensional image data. 

14. The image data reproduction apparatus according to claim 1 2 or 1 3 , 
15 further comprising file type determination means for analyzing a structure of said 

multimedia information file so as to determine whether three-dimensional image display 
control information is included; wherein 

said file type determination means determines whether said multimedia 
information file includes the three-dimensional image data. 



20 



15. The image data reproduction apparatus according to claim 1 2 or 1 3 , 
further comprising file type determination means for analyzing a structure of said 
multimedia information file so as to determine whether three-dimension identification 
information is included; wherein 

said file type determination means determines whether said multimedia 
information file includes the three-dimensional image data or determines on which three 
dimensional display scheme data is based on. 
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16. An image data reproduction apparatus, comprising: 

reception means for receiving a multimedia information file including three- 
dimensional image display control information obtained by encoding a parameter for 
displaying three-dimensional image data and said three-dimensional image data, or two- 
5 dimensional image data; and 

file type determination means for analyzing an extension of said multimedia 
information file; wherein 

said file type determination means determines whether said multimedia 
information file includes said three-dimensional image data or determines on which three 
10 dimensional display scheme data is based on, based on said extension. 

17. The image data reproduction apparatus according to claim 1 6, wherein 
said three-dimensional image display control information includes at least one of 
first information indicating a number of viewpoints of said three-dimensional image data, 
15 second information indicating from which viewpoint position said three-dimensional 
image data is obtained, third information indicating a direction of sub-sampling of said 
three-dimensional image data, fourth information indicating arrangement of a camera 
that has picked up said three-dimensional image data, fifth information indicating a 
maximum shift amount when a parallax image of said three-dimensional image data is 
20 shifted, sixth information indicating whether a border is to be displayed around an image 
of said three-dimensional image data, seventh information indicating border image data 
to be displayed around the image of said three-dimensional image data, and three- 
dimension identification information indicating that said multimedia information file 
contains the three-dimensional image data. 



25 



18. An image data reproduction apparatus reproducing a multimedia 
information file including both of image pick-up condition information indicating an 
image pick-up condition for a three-dimensional image and three-dimensional image data, 
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or at least two-dimensional image data, wherein 

said image pick-up condition information includes at least one of information 
indicating a number of parallaxes in a horizontal direction and information indicating a 
number of parallaxes in a direction perpendicular thereto. 

,5 

19. An image data reproduction apparatus reproducing a multimedia 
information file including both of image pick-up condition information indicating an 
image pick-up condition for a three-dimensional image and three-dimensional image data, 
or at least two-dimensional image data, wherein 
10 said image pick-up condition information includes at least one of information 

indicating a camera arrangement shape, information indicating an interval between 
adjacent cameras, and information indicating a distance from a camera arrangement 
plane to a convergence point. 

15 20. An image data recording medium recording a multimedia information file 

including both of three-dimensional image display control information generated by 
encoding a parameter for displaying three-dimensional image data and said three- 
dimensional image data, or at least two-dimensional image data. 

20 2 1 . The image data recording medium according to claim 20, wherein 

said three-dimensional image display control information includes at least one of 
first information indicating a number of viewpoints of said three-dimensional image data, 
second information indicating from which viewpoint position said three-dimensional 
image data is obtained, third information indicating a direction of sub-sampling of said 

25 three-dimensional image data, fourth information indicating arrangement of a camera 
that has picked up said three-dimensional image data, fifth information indicating a 
maximum shift amount when a parallax image of said three-dimensional image data is 
shifted, sixth information indicating whether a border is to be displayed around an image 
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of said three-dimensional image data, seventh information indicating border image data 
to be displayed around the image of said three-dimensional image data, and three- 
dimension identification information indicating that said multimedia information file 
contains the three-dimensional image data. 

22. (Cancelled) 

23. The image data recording medium according to claim 20 or 21, wherein 
said multimedia information file is provided with a different extension between 

when said multimedia information file contains the three-dimensional image data and 
when said multimedia information file contains no three-dimensional image data. 

24. The image data recording medium according to claim 23 , wherein 
said extension adapts to a plurality of different three-dimensional display 

methods and is different for each of said plurality of three-dimensional display methods. 

25 . An image data recording medium recording a multimedia information file 
including both of image pick-up condition information indicating an image pick-up 
condition for a three-dimensional image and three-dimensional image data, or at least 
two-dimensional image data, wherein 

said image pick-up condition information includes at least one of information 
indicating a number of parallaxes in a horizontal direction and information indicating a 
number of parallaxes in a direction perpendicular thereto. 

26. An image data recording medium recording a multimedia information file 
including both of image pick-up condition information indicating an image pick-up 
condition for a three-dimensional image and three-dimensional image data, or at least 
two-dimensional image data, wherein 
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said image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between 
adjacent cameras, and information indicating a distance from a camera arrangement 
plane to a convergence point. 

27. (Cancelled) 

28. (Cancelled) 

29. (Cancelled) 

30. (Cancelled) 

31. (Cancelled) 

32. (Cancelled) 

33 . An image data recording medium recording, in a recording area, a 
multimedia information file including both of three dimensional image display control 
information generated by encoding a parameter for displaying three-dimensional image 
data and said three-dimensional image data, or at least two-dimensional image data, 
wherein 

said recording area includes an image recording area for recording said three- 
dimensional image data or the two-dimensional image data, an audio recording area for 
25 recording audio data, and a sub code area for recording associated information. 

34 . The image data recording medium according to claim 3 3 , recording at least 
a portion of said three-dimensional image display control information in said image 
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recording area. 

35. The image data recording medium according to claim 3 3 , recording at least 
a portion of said three-dimensional image display control information in said audio 
recording area. 

36. The image data recording medium according to claim 33, recording at least 
a portion of said three-dimensional image display control information in said sub code 
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(Cancelled) 
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